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In this paper, we analyze a technique for accurately detecting 
transmitted data symbols contained in a modulated signal that has 
been degraded by a linear dispersive channel and additive Gaussian 
noise. The approach uses an adaptive equalizer which provides 
preliminary decisions to an adaptive canceller. The canceller output 
is used to remove the interference from an adaptive matching filter, 
resulting in the desired signal. Channel equalization attempts to 
invert the channel transfer function, while avoiding excessive noise 
enhancement. However, cancellation (as used in echo cancellers), 
attempts to generate a replica of the interfering signal and subtract 
it from the actual received signal containing the sum of the desired 
signal and interference. The cancellation approach, unlike equali- 
zation, offers the possibility of removing interference without enhanc- 
ing the level of noise already present in the received waveform. 
Simulation results for transmission over practical channels show 
significant improvement of linear cancellation over both linear for- 
ward and decision- feedback equalization. 

I. INTRODUCTION 

For the past twenty years, engineers have been seeking new tech- 
niques to combat the intersymbol interference (isi) in data transmis- 
sion over band-limited channels. Adaptive equalization with the mean- 
square algorithm has been the major technique that allowed a sub- 
stantial increase in attainable transmission rate. 1 If the channel has 
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only phase distortion, then the linear fractionally spaced equalizer can 
eliminate virtually all of the isi without enhancing the noise level. 2,3 
However, when amplitude distortion is present in the channel, any 
adaptive linear equalizer (le) must compromise between inverting the 
channel transfer function and avoiding excessive noise enhancement. 
Inevitably, some noise enhancement occurs. Decision-feedback equal- 
ization can offer somewhat improved performance when amplitude 
distortion is present. 4,5 By using the Viterbi algorithm, 6 maximum- 
likelihood receivers, in principle, offer the best performance possible 
but depend on adaptive estimators of the channel and require an 
unpractically high complexity when the channel impulse response is 
long, as in the case of the typical telephone channel. 

If there were no isi, the probability of error in detecting the trans- 
mitted data level (i.e. ±1 or ±3) would be the same as if only one such 
pulse were transmitted in isolation. In that case, the optimal receiver 
(for Gaussian noise) would be a matched filter and would yield a 
certain error probability, P . When pulses are sent sequentially, the 
effect of isi cannot be totally eliminated. The maximum likelihood 
estimator of the entire sequence of transmitted symbols is known to 
result in an error probability that is somewhat larger than Po. 

In this paper, we describe a cancellation technique designed to 
achieve isolated-pulse, matched-filter performance. Extensive simula- 
tion results confirm that there is a significant improvement over linear 
or decision-feedback equalization for severe amplitude-distorting chan- 
nels of practical interest. 

II. BACKGROUND AND MOTIVATION 

The idea of cancellation was used for the echo problem in two-wire 
telephony (see Ref. 7), where the received signal contains an interfer- 
ence component that is a filtered and delayed version of an "originat- 
ing" signal. In that application, the originating signal is actually 
available at the same location. However, in data transmission the 
originating signal — the transmitted data stream — is not directly ob- 
servable at the receiver. The idea of using preliminary decisions to 
generate an intermediate estimate of the transmitted data signal was 
independently proposed by various investigators. All of the proposals 
included adapting the coefficients of a filter that forms a replica of the 
isi. Adaptation is, of course, needed since the appropriate filtering 
operation is not known in advance and can vary with time. Hirsch and 
Proakis proposed the cancellation scheme with the essential structure 
in Figure l. 8,9 Here the canceller attempts to remove the isi directly 
from the received line signal. This approach does not achieve improved 
performance over linear equalization if there is phase distortion. In 
this paper, we describe a linear canceller (lc) structure where a 
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Fig. 1 — First generation linear canceller. 

transversal filter W is used instead of the delay in Fig. 1. Both C and 
W are adapted simultaneously with the error signal between the input 
to the final detector and the appropriate reference. 

The motivation for this structure stems from the need to effectively 
detect high-speed data on channels that have both a high noise level 
and substantial amplitude (slope) and phase distortion. In certain 
conditions of practical interest, even if the equalizer were of infinite 
length, the noise enhancement of linear or decision feedback equali- 
zation makes it impossible to achieve the required error rate. Never- 
theless, linear equalization is sufficient to obtain fairly moderate error 
rates so that the detected symbols may be adequate as preliminary 
decisions for a cancellation scheme. 

In Section 3, we provide intuitive reasoning that the optimal choice 
for W is a matched filter, and the optimal C is a canceller whose tap 
weights are the samples of the channel autocorrelation function, except 
for the center tap, which has zero weight. We show in Section 4 that 
this is true under the assumption that the preliminary decisions Ak are 
correct. Section 5 covers adaptive operation and Section 6, simulation 
results. 

III. FORMULATION 

Let the transmitted data symbols be denoted A\, Ai, A3, ■ • • with 
each complex valued symbol having real and imaginary parts restricted 
to one of a finite set of values (i.e. ±1, ±3). A complex-valued pulse 
shape p(t) is used to generate the baseband transmitted data signal 
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s(t) = 'ZAkp(t-kT). (1) 

k 

The linear distortion of the channel results in the received waveform 

X(t) = ^A k h(t-kT) + V(t), (2) 

k 

where V(t) is white noise and h(t) is the overall channel impulse 
response. 

Suppose initially that the receiver consists of a matched filter and a 
sampler (rate 1/T) followed by a symbol detector as shown in Fig. 2. 
The matched filter has impulse response 

W(t)=h*(LT-t), (3) 

where * denotes complex conjugation and the integer L is chosen large 
enough so that the output is small for t < 0. The output of the sampler 
is then 

U(mT) = £ A k r(mT - kT - LT) + V l (mT), (4) 

k 

where V l {t) \s the colored noise at the matched filter output and r(t) 
is the autocorrelation function of the pulse h(t); that is, r(t) = 
J-oo h(s)g(s + t)ds. Equation (4) can be written as 

U(mT) = A m -Lr(0) + V\mT) + I m -u (5) 



where 



I m -L= X A k r(mT-kT-LT). 

ki*m-L 



(6) 



Suppose that at time t = mT the receiver must detect the currently 
observable symbol A m -L and it knows all prior symbols A m -L~i, 
Am-L-2. . ■ • and all subsequent symbols A m -L+u A m -L+2, ... , A m that 
determine the value l m -i of the total isi. In this case, I m - L is a known 
constant and can be subtracted from U(mT). What remains is exactly 
the output value that the matched filter would produce if the trans- 
mitter sent a single isolated pulse A m -LP\t - (m — L)T]. Hence, the 
ideal performance, with error probability P , would be achieved. 
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Fig. 2 — Model of transmitter, channel and matched filter (mf). 
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Fig. 3 — Decision feedback equalizer. 



The above reasoning suggests that we could approach the ideal — 
isolated symbol — performance with each symbol decision if we could 
generate a good estimate of the total isi, I m -L, at each sampling instant, 
t = mT. The decision feedback approach can be viewed as a partial 
step in this direction. This approach is based on the idea that we can 
estimate the prior symbols called precursors by storing and processing 
the outputs A m -L-\, Am-L-2,... already produced by the detector. The 
part of I m -L determined by the precursors can then be constructed. By 
applying the decision A, to a feedback filter, the output is subtracted 
from U(mT) and the resultant signal is applied to the detector. The 
decision-feedback equalizer (dfe) is shown in Fig. 3. Since we have 
not removed all of the isi, the resulting performance will be inferior to 
that of the isolated-pulse case. This discussion shows that the dfe 
technique can be regarded as a partial step towards the goal of totally 
removing isi. We next examine how we go beyond the stage of 
postcursor cancellation to include precursor cancellation. 

Suppose at time mT we could also eliminate the subsequent, post- 
cursor, symbols A m -L+\, A m -L+2, . . . , A m that also contribute to the total 
interference at time mT. Then, using eq. (6), an estimate of the total 
isi, l m -L, would be available at time instant mT. This is not possible 
using the output of the detector in Fig. 2. However, suppose a separate 
equalizer operates on the received data signal y(t) as shown in (a) of 
Fig. 4. If optimally designed, it will have a modest error rate, and we 
can use its decision A„, as preliminary or tentative decisions for the 
purpose of constructing our estimate of 7 m -L. Now there is no problem 
in obtaining both precursor and postcursor estimates needed to form 
I m -L- By introducing a fixed time delay, D, to the received signal prior 
to the matched filter as shown in (a), the le has a head-start in 
estimating data symbols. A practical implementation of an adaptive 
passband canceller would take the form shown in (b) of Fig. 4. 

The delay D can actually be incorporated into the matched filter by 
choosing L suitably large. The cancellation filter Q_ produces the 
estimate l m -L of the actual interference 



Im-L= £ A k r(mT-kT-LT), 

k^m-L 



(7) 
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Fig. 4 — (a) Linear canceller, (b) Passband linear canceller structure. 
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where Ak is the sequence of preliminary decisions. Note that the 
transversal filter C, which takes as input A m and produces the output 
tm-L at time mT, has an impulse response 



m \r[i - (m - L)T] i^m-L 
i = m — L' 



(8) 



We shall see in Section IV that, under the assumption of perfect 
preliminary decisions, this is indeed the optimum impulse response in 
the mean-square sense. 

IV. OPTIMAL CANCELLATION 

4. 1 Derivation of optimal filter coefficients 

To determine the optimal pair of filters Wand C for the cancellation 
scheme, we make the simplifying assumption that the preliminary 
decisions available from the le are correct. We focus on the structure 
shown in Fig. 5, where the filter W, called the matching filter, is a 
T/2-spaced infinite length transversal filter preceded by a sampler 
operating at rate 2/T samples per second. The filter £, called the 
canceller, is a T-shaped infinite length transversal filter. 

The matching filter W has input samples, yi = y(lT/2), where y{t) is 
the received line signal, and the output, U n , of W is taken at time 
instants, t = kT, as indicated in Fig. 5 by the 1/T rate sampler. The 
input to canceller Q is the true data sequence {A n } since we have 
assumed the tentative decisions are correct. Thus, Fig. 5 shows Q_ being 
fed directly by the transmitted data symbols. It is not necessary to 
explicitly consider the time delay D since we are allowing infinite 
length filters. The output of the canceller V„ is subtracted from the 
matching-filter output. This difference producing U n — V n to be applied 
to a slicer may be viewed as a linear estimator of the data symbol A n . 
The goal is to determine the filters W and C that minimize 

E n = E(\e n \ 2 ), (9) 

the mean-square error (mse), where e n = U n — V n — A n . 
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Fig. 5 — Model of a linear canceller. 
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Let a(t) denote the additive receiver noise as shown in Fig. 5. Then, 
the input to the matching filter is given by 



yi = exp(/«o/T/2) £ AMIT/2 - vT) + a(lT/2) 



= exp(ju lT/2) 



YAMIT/2 - vT) + ai(ZT/2) 



(10) 



where h(t) is the complex impulse response of the channel and includes 
the effect of the transmitter shaping filter p(t) as treated in Section 
III. The term ai(-) is the complex baseband noise sample. All sum- 
mations are over the integers from — oo to oo, unless otherwise indicated. 
The output U n of the matching filter is 

U n = exp(-jaonT) £ Wty 2n -k, (11) 

k 

where W, denotes the tap weights of W. Let hi = h(lT/2) and define 

h = I W:h t - V . (12) 

Then U n may be written in the form 

Un = lA s b 2 n-2 S + Nn, (13) 

s 

where 

N n = £ W!<X2n-s (14) 

s 

is the noise at the output of the matching filter. 

We shall let C, denote the ith tap weight of the cancellation filter for 
each integer i, except i = 0. We make the constraint that the center 
tap weight of the cancellation filter is zero. This restricts the role of 
the canceller to removing isi and prevents the canceller from making 
use of the current data symbol which must be estimated by the output 
signal from the matching filter. The canceller output V n is given by 

V n =l CtAn-i, (15) 



i#0 



and we assume that 



£|A„| 2 =1, (16) 



which is a convenient normalization of the data symbol power level. 

To minimize the mse in eq. (9), we differentiate E n with respect to 
the complex tap weights {C*} and { W k ) and set the derivatives to zero. 
Using eq. (15), it can be shown to yield 
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E(g An-m) =0 m ^ 0, (17) 

and using eq. (11), 

exp(-jwonT)E(eZy 2 n- m ) = allm. (18) 

Thus, these optimality conditions require that the error signal e be 
orthogonal to the observable inputs to the C and W filters, namely, 
{A n } and {y„}. 

We discuss two cases of interest. In Case 1, the channel is wideband. 
We assume that the W filter processes the line signal directly from the 
channel without prior band-limiting so that even when sampled at a 
rate of 2/T, the noise samples are uncorrected. In Case 2, which is 
more relevant to our situation of a channel band-limited to the voice 
frequency range, the noise samples at T/2 spacing are correlated. 

Case 1. Uncorrected noise samples 
In Case 1, 

E[a{lT/2)a*(kT/2)] = o 2 ^ 
where a 2 is the noise variance. We also define a new term, 

Rh(I) = X h*(jT/2)h(jT/2 + /T/2), (19) 

j 

which is the autocorrelation function of the T/2-sampled impulse 
response, h{jT/2). Then, with 

/ r 2 

= Rn(0), (20) 

we show in the Appendix that the matching filter has T/2-spaced tap 
weights 

W m = exp(-j\oomT/2) k( ~ mT/ J ) , all m, (21) 

tit, + o 

which is clearly proportional to a matched-filter impulse response. The 
C taps are shown in the Appendix to be 

c m=T* -jrRh(.2m), m*0. (22) 

(Eh + a") 

Thus, the canceller impulse response, for m 5^ 0, is that of the overall 
T-spaced impulse response of the channel and matching filter. 

Case 2. Correlated noise samples 

As described earlier, Case 2 corresponds to the voiceband telephone 
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channel, where the noise has approximately the same bandwidth as 
the signal so that noise samples at T/2 spacing are correlated. 
The noise correlation is 

E[(akT/2)a*(lT/2)] = R n (k - I). 

We define W(w) as the Fourier transform of the W tap weights, S„(w) 
is the sampled noise spectrum, and H(u) is the Fourier transform of 
the channel-sampled impulse response. Then, with 



T f- 

_ _ I T 

**) — 
J T 

we show in the Appendix that 



w*>) = , ? { ~LT\' < 24 > 

(1 + £)&(-«) 
The corresponding Fourier transform of the canceller is 

C( W )— L- l^-^' 2 . (25) 

UW 1 + £ S„(- to + <o ) 

Note that since 

Rt (-2m) = R h (2m), 

and S„(-w + w ) is real, we see from eqs. (22) and (25) that the 
optimum, infinitely long canceller sampled impulse response is Her- 
mitian symmetric about the center, i.e. 

Cm - C* m . (26) 

4.2 Derivation of mse 

We now derive the mse achieved for Case 1, under the assumption 
that W and C have the optimal impulse responses given by eqs. (21) 
and (22), respectively. The matching filter output is given by 

U n = F X o I A 8 R h (2n - 2s) + N n . (27) 



>h 

.2 



The noise, N n , is the result of applying white noise with variance a to 
the matching filter eq. (65). Hence, using eqs. (66) and (67), we find 
that 

E ^'-WT77- (28) 

Also, the canceller output is given by 

V n = F * o £ A 8 R h (2n - 2s). (29) 

tjh + O s+n 
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Hence, the error signal, with Rh(0) = Eh, is 



E h 



€ n = U n - V n ~ A n = 



so that, using eq. (30), the mse is 

E n = E\e n \ 2 = 



Eh + Oh 

o 2 



An T IS n A n 
An + N n , 



Eh + <? 



E h + <r 2 ' 



(30) 



(31) 



The s/n, p, at the output of the cancellation system is defined as the 
ratio 



P = 



E\Un-Vn-Nn\ 



Hence, we find that 



E\N n \ 



Eh 



(32) 



(33) 



4.3 On the property of Invarlance of mse to timing phase 

The mse expression in eq. (31) can be written in terms of the 
channel-sampled power spectrum. If H{u>) is the Fourier transform of 
the overall impulse response h(t), then the transform of h(jT/2) is 






w + 



\irk 



>l«l<y. 



(34) 



and 



T C— 



Ait 



\\ l#<« 



)\ 2 du. 



(35) 



Therefore, from eq. (31) the mse of the optimum lc, normalized to 
unit signal power, is 

-2r 



£lc = 1 



47T0 2 ]-* 



T 9 \ff(co)\ 2 du>+l 



} 



If the matching filter were T-spaced, then we have 



(36) 



(37) 
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and 



£A~^|U#(«)| 2 d«. 

J T 



(38) 



We can compare the results with similar expressions for the optimum 
le and dfe in Ref. 5 which assume matched filters preceding the 
equalizers. They are 



Ei 



--f 

2-n- J 



T 

-1 Y(w) + 1 
r 



rfco, 



and 



where 



Eufe = exp 



-— r.in[y(«) + i]d 



.). 






H\a + 



2-rrk 



(39) 



(40) 



(41) 



The expression in eq. (39) is the same as that for an infinitely long 
fractionally spaced le, 3 whereas the result for a symbol-spaced equal- 
izer is 

2 



Eue. 



■im 



?»("" 



+ 1 



do). 



(42) 



Finally, we note that if the overall channel-impulse response has less 
than 100 percent rolloff and the matching filter is T/2-spaced, then 



#(«)-- #<<*), 



and 



E, 



4-J^? 



\H(o>)\ 2 du. 



Clearly, Elc is independent of any phase characteristics and, hence, 
the canceller performance is insensitive to timing phase. This property 
is shared by the fractionally spaced le 2,3 and the symbol-spaced le 
and dfe which are preceded by matched filters, as exhibited by eqs. 
(39) and (40). On the other hand, by itself, the symbol-spaced le is 
sensitive to timing phase, as seen in eq. (42), because the integrand is 
a function of the folded spectrum of the channel. This is because a 
symbol-spaced filter cannot properly synthesize a proper matched 
filter. Likewise, the lc with a T-spaced matching filter is sensitive to 
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timing phase, although some simulations have indicated that the effect 
of a bad timing phase seems to be less on the lc than on the le. 



V. ADAPTIVE CANCELLER STRUCTURE 

In practice, we have finite length filters and the ensemble averages 
described above are not available to the receiver. As in the case of the 
adaptive le, we adjust the complex {C*} taps of the canceller and 
{ Wk) taps of the matching filter to minimize the instantaneous squared 
error, 

|e„| 2 = \U n - Vn-A n \ 2 , (43) 

at each time instant nT. As shown in (b) of Fig. 4, U n and V„ are the 
outputs of the matching filter and canceller, respectively, where 

L-\ 

U n - exp[-/(wo/iT + d n )] £ W£y2n-k, (44) 

-L 

and 

V n = I CtAn-k, (45) 

k—M 

where we have 2L complex W taps at T/2 spacing and 2M complex (± 
taps at T spacing. Unlike the ideal case in Fig. 5, A n -k are the tentative 
decisions obtained from the le, and 0O n is the estimate of any phase 
jitter present. The value of A n in eq. (43) is that of the ideal reference 
in the training mode and is the receiver's output decision in the 
decision-directed mode of operation. Note that e n in eq. (43) is a linear 
function of the tap weights {C*, Wk) so that it is possible in theory to 
jointly adapt the tap weights to achieve a unique mse. 

It can be shown that the gradients of | e n \ 2 with respect to the tap 
weights are given by 

%^=-2enM n -*, (46) 

and 

8k 



2 

= 2exp[->(«onr + fc)]ri >&-*. (47) 



dWk 

Thus, the adjustment algorithms are 

( h = —M ... M 
Ck(n + 1) = C k (n) + fie* A n -k * n ' ' (48) 
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and 

W k (n + 1) = W k (n) - Pexp[-j(uonT + 6 n )^y2n-k, 

k - L, . • • , L - 1. (49) 

The step size /? is chosen to obtain reasonably fast tap convergence 
without the algorithm becoming unstable. The problem is similar to 
that addressed in Ref. 10 for adaptive equalizers where it is proved 
that the step size needs to satisfy the constraint 

0<p< Th' 

where L is the total number of taps, (2L + 2M) in our case, and {x 2 } 
is the average input signal power. The fastest initial convergence is 
achieved with 

VI. COMPUTER SIMULATION 

The performance of the system over three channel models is evalu- 
ated. Channel 1 has a flat amplitude response over the entire voiceband 
frequency with little delay distortion, except near the lower band edge. 
Channel 2 has moderate amplitude and delay distortion, which just 
meets the private-line conditioning, and Channel 3 has severe ampli- 
tude distortion. These characteristics are shown in Fig. 6. Pseudo- 
random digital data at levels ±1 and ±3 are used to modulate the 
quadrature amplitude modulation (qam) transmitter at a rate of 9.6 
kb/s and the resulting signal is sent over one of the channels. Additive 
Gaussian noise and, whenever desired, phase jitter are introduced into 
the channel. The input signal-to-channel noise ratio (s/n,) will be 
taken to be either 30, 24, or 20 dB. 

In the simulations, the lc filters {C*} and { W k ) are allowed to start 
adapting after 1000 iterations to ensure that the le has converged 
sufficiently and is able to provide good tentative decisions for the lc. 
The performance of the lc is measured by the output s/n 
(s/rio). This is defined as the ratio of the average data symbol power to 
the output noise power, which is taken to be the time average of the 
squared error at the lc output. We exhibit plots of s/n, as a function 
of time, expressed in number of data symbol intervals, for both the le 
and lc. Scatter plots of the output signal constellation are also pro- 
vided. In the absence of any impairments, the plot would show 16 
points with the x and v coordinates at ±1, ±3. 

In the simulations, both lc filters span 31 data symbols so that the 
matching filter has 62 T/2 taps, while the canceller has 31 taps. The 
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Fig. 6 — Channel characteristics, (a) Channel 1. (b) Channel 2. (c) Channel 3. 

le has 64 T/2 taps to sufficiently span the channel-impulse response. 
An initial step size of 0.0005 is chosen for updating all the tap coeffi- 
cients and it is reduced to 0.00005, when the taps have nearly con- 
verged, to get a small final mse. 

We first compare the performance of the lc and le over the three 
channels described earlier using an s/n, of 24 dB. The receiver switches 
from the ideal reference to the decision directed mode of operation 
after 3000 iterations. Figures 7, 8, and 9 show the receiver s/rio as a 
function of time for the three channels. 

Note that in the absence of significant distortion, as in the case of 
the Channel 1, the le and lc perform equally well, and we see that 
s/no is approximately s/n,. However, the le degrades more than the 
lc when the channel is more severely distorted in amplitude. 

Table I summarizes the results of several simulation runs, for the 
LE, dfe, and lc, over Channels 2 and 3 and with various s/n,. Results 
for Channel 1 are not presented because all three schemes do not 
suffer any significant degradation. These results are based on the use 
of an ideal carrier demodulating phase. Note that for Channel 2, the 
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Fig. 9 — Performance of LC and le over Channel 3. 



LC is able to attain s/rio's which are very close to s/n„ for all three 
cases. The gain is about 2 dB over the le and about 1 dB over the 
dfe. If we can use the rule of thumb that every 1-db gain corresponds 
to an order of magnitude reduction in error rate, then the lc would 
have an error rate two orders of magnitude less than the le and one 
order less than the dfe. The results for Channel 3, again, show the 
improvement over both le and dfe. We see that the le performance 
degrades significantly when the channel has considerable slope distor- 
tion, and on the average, it suffers losses of about 4 dB from the input 
s/n. The lc shows improvements of about 3 db over the LE and 1 dB 
over the dfe in all three cases. 

We conclude this section by comparing the scatter plots of the 
receiver outputs after processing by an le and an lc. In this example, 
Channel 3 is used and the s/n, is 24 dB. Figure 10 is the result of linear 



Table I — Comparison of linear equalizer, decision feedback 
equalizer, and canceller performances 





Channel 2 


Channel 3 


s/n, (dB) 


20 24 30 


20 24 30 


Linear equalizer s/n„ 

Decision feedback equalizer s/n„ 

Canceller s/n,, 


18.0 22.1 26.8 

19.1 23.0 27.9 
19.7 23.8 29.2 


15.4 20.4 25.5 
17.3 22.0 27.1 

18.5 23.1 28.7 
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equalization. There is a considerable point spread because of severe 
amplitude distortion. Figure 11 shows the result of cancellation, which 
considerably tightens the spread and provides a larger noise margin 
than equalization. 

VII. CONCLUSION 

Cancellation is a powerful alternative approach to linear equalization 
that strives to mitigate the effects of slope distortion. This technique 
is based on cancelling the sidelobes of the overall channel-impulse 
response, unlike equalization, which attempts to invert the overall 
channel. 

Simulation results of qam transmission at 9.6 kb/s have shown that 
the canceller performs impressively, especially for severely amplitude- 
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Fig. 10 — Linear equalizer output signal constellation. 
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Fig. 11 — Linear canceller output signal constellation. 

distorted channels, where neither the le nor the dfe is satisfactory. 
The lc needs an le to provide it with reasonably good tentative 
decisions to perform the cancellation. It is then able to provide a final 
output which has a lower mse than the tentative output. In addition, 
the canceller is insensitive to phase distortion, provided the matching 
filter has an input sampling rate at least twice the data symbol rate. 
Hence, the lc accommodates the task of a fractionally spaced le as 
well. 

In summary, we have introduced a fundamentally new approach 
that performs better than either the linear or decision-feedback equal- 
ization, as confirmed by simulation results. Moreover, a recent theo- 
retical study 11 applicable to this cancellation method further confirmed 
the effectiveness of our approach. 
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APPENDIX 

We derive the optimum minimum mse lc filters C and W under the 
assumption of (i) uncorrelated noise samples, and (ii) correlated noise 
samples. 

Case 1. Uncorrelated noise samples 

In Case 1 

E[a(lT/2)a*(kT/2)] = a?8ik, 

where a 2 is the noise variance. Consequently, we have, from eqs. (10), 
(11), and (15), 

E{U* n A n - m ) = E W*exp(y«o*T/2) h*[(2m - k)T/2], (51) 

k 

E(V*An- m ) = C m , m* 0, (52) 

E(yL-ky*-m) = exp[y«o(* - m)T/2] YLE{A*h*[(2n-k)T/2 

P 9 

-pT]+a?[(2n-k)T/2]} 
X {A q h[(2n - m)T/2 - qT] 
+ ai[(2n - m)T/2]} 
= exp[ju (k - m)T/2] £ h*(pT - kT/2) 



= R k h (k-m) 



X h(pT - mT/2) + <?8 km 

+ (?8 km , (53) 



where 

R l h(r) = 



exp(ywoT) £ h * (kT + T/2)h(kT + 7/2 + t), / odd 
k 

expOWr) £ h * (kT)h(kT + t) 1 even 

k 



and we also define another term, 

Rh(I) = £ h*(jT/2)h(jT/2 + IT/2), 



(54) 



(55) 



which will be used later. Equation (55) is the autocorrelation function 
of the T/2-sampled impulse response h(jT/2), whereas eq. (54) is T- 
spaced. So, from eq. (11) 

E(U* yzn-m) = expOWiT) £ W k E( yt-ky^-m) 



I W k R k h (k - m) + <?W„ 
k 



expOWiT). (56) 
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Also, 

E(A*n- k y 2n -m) = exp[y«o(2n - m)T/2] £ E(AUA P ) 

p 

X h[(2n - m)T/2 - pT] 

= expOo(2/i - m)T/2]h[(2k - m)T/2]. (57) 

Therefore, 

E(Vty2n-m) = expL/«o(2» - m)T/2] 2 C*ft[(2i - m)T/2], (58) 

and 

E(Aty 2n - m ) = expL/«o(2n - m)T/2]/i(-mT/2). (59) 

By substituting eqs. (51) to (59) into eqs. (17) and (18), we have 

Cm - 2 W k exp(ju>okT/2)h*[(2m - k)T/2], m * 0, (60) 
* 

and 

X W k Rh(k - m) + <£W m - exp(-ywomT/2) 

A 

x 2 dh[(2i - m)T/2] + exp{-j<*>mT/2)h(-mT/2), all tot. (61) 

i-0 

We next solve for {C,} and {Wi} from this pair of equations. Substi- 
tuting eq. (60) into eq. (61) gives 

V wM(k -m) + <tiW m = exp(-7a )0 mT/2) £ £ W k 

x exp(juokT/2)h*[(2i - k)T/2] 
x h[(2i - m)T/2] 
+ exp(-jaomT/2)h(-mT/2) 
- 2 W*[exp>wo(* - m)T/2] 

A 

x%h*[(2i-k)T/2] 

i 

X /i[(2i - m)T/2] + exp(-7'womT/2) 
x h(-mT/2)[l - 2 W*exp 

A 

X ijwokT/2)h*(-kT/2)] 



= £ W*flJ(A - m) + exp(-ycoomT/2) 

A 

X A(-mT/2)(l - 0), (62) 
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using eq. (55), and where 

P = I Wtiexp{j<*&T/2)h*(-kT/2). (63) 

k 

Therefore, we obtain the equality 

a 2 W m = exp(-ju T/2)h(-mT/2)(l - $), all m, (64) 

or 

W m = exp(-ywomT/2)A(-mT/2) (1 ~f\ (65) 

On substituting eq. (65) into eq. (63), we can show that 



where, using eq. (55), 



M/ ¥ 



= Rh(0). (67) 

From eqs. (66) and (65), we see that the matching filter has T/2-spaced 
tap weights 

W m = exp(-ytoomT/2) h{ ~ mT/ *\ all m, (68) 

OA + O 

which is clearly proportional to a matched-filter impulse response. 

Case 2. Correlated noise samples 

As described in Section IV, Case 2 corresponds to the voiceband 
telephone channel where the noise has approximately the same band- 
width as the signal so that noise samples at T/2 spacing are correlated. 

With noise correlation 

E[(ockT/2)a*(lT/2)] = R n (k - I), 
and eq. (53) becomes 

E(yL- k y2n- m ) = Rtik - m) + R n (k - m). (69) 

Then, in place of eq. (56), we have 

E(U: y 2 n-m) = £ W k [R k h (k -m)+ R n (k - »)]. (70) 

k 

Consequently, eq. (62) becomes 

X WMk - m) = exp(->coomT/2)/i(-mT/2)(l - j S), all m. (71) 
k 
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We have to solve a set of linear equations for the W taps, and the 
solution in the time domain is not obvious. Instead, we examine the 
results in the frequency domain. Transforming both sides of eq. (70) 
gives 

W(w)Sn(-to) = (1 - P)H(-o> -wo); 

that is, 

W(u) = (1 - P)H(-u -<oo)/S„(-«), (72) 

where W(w) is the Fourier transform of the W tap weights, S„(w) is 
the sampled noise spectrum, and H(u) is the Fourier transform of the 
channel-sampled impulse response. Again, W(co) takes the form of a 
filter matched to the channel with additive band-limited noise. 
The constant /? can be written as 

T f- ~ 
B = —\ T 9 H*(-u -uo)W(a)dw (73) 

j T 
On substituting eq. (72) into eq. (73), we can solve for as 



P- 



i + r 



where 



j T 

Consequently, from eq. (72), 

TI7Y X H(—U "WO) , 7R v 

W(u) = — r— — -. (75) 

(1 + £)S„(-fc>) 

Even though the C and W filters are jointly adapting, the C taps 
are, in fact, slaved to the VTtaps. On substituting eq. (68) into eq. (60), 
we obtain, using eq. (55), 

G- - ,,, \ * lh(-kT/2)h*[(2m - k)T/2] 

(JLh + a) k 

1 R h (2m), m^O. (76) 



(E h + a 2 ) 



Thus, the canceller-impulse response (for m ^ 0) is that of the overall 
T-spaced impulse response of the channel and matching filter; that is, 
the canceller recreates the entire isi component present in the match- 
ing filter output signal as long as the correct data symbols are applied 
to the canceller. 
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The C taps corresponding to eq. (75) can similarly be obtained. From 
eq. (71), we have 

h[(2m-k)T/2] 

1 



, , m expL/«o(A - 2m)T/2] £ Wift.</ - £ + 2m). (77) 
(1 — p) i 

On substituting into eq. (60), we have 

C m = ex Py c0o ^ r) £ ^Wf/e n *(2m + / - k), m*0. (78) 

(1 — p) *,/ 

If, in addition, we define 

Co=— i-rr -IWkWTRZd-k), 

(1 — 0) A-,/ 

we can transform the sequence {C m } to obtain 
C(w) = £ C m exp(-jwmT) 

= 77^rS W A exp[-y((o - Wo )^T/2] 
X £ Wfexp[j(w - w )ZT/2] 
xY l R*(2m + l-k) 

m 

X exp[-y(co - wo) (2m + / - k)T/2] (79) 

Since both indices k and / run from — oo to oo, we can replace the 
summation over m as 

£ R*(p)'exp[-j(ui - uo)pT/2] = S*(- « + «o) 
p 

= Sn(~ W + Wo). 

Therefore, eq. (79) can be simplified to 

CM = * | W(u - wo) 1 2 S n (- w + wo). (80) 

Substituting for W(a)) from eq. (72) gives 

(l-/?)lff(-w)| 2 

C(w) = — — — — , (81) 

iS„(- w + wo) 



or, from eq. (74), 



C(u) - 1 JML. (82) 

1 + £ -S n (— W + Wo) 
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